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What is claimed is: 

CLAIMS 



1. A method for associating haptic sensations with sound data to assist in navigating , 
5 through and editing said sound data, the method comprising: 

loading at least a portion of said sound data into a memory of a computer; 

playing said sound data such that an audio signal is generated and used for outputting 
sound from an audio device, wherein said playing of said sound is controlled by user input 
received by said computer from a user for navigation through said sound data; and 

10 generating haptic commands based on said sound data, said haptic commands used to 

output haptic sensations to said user by a haptic feedback device manipulated by said user and in 
communication with said computer, said haptic sensations corresponding to one or more 
characteristics of said sound data to assist said user in discerning features of said sound data 
during said navigation through and editing of said sound data. 

15 2. A method as recited in claim 1 wherein said user can control a speed of said playing of 

said sound data. 

3. A method as recited in claim 1 wherein said user can control a direction of said 
playing of said sound data, said direction including forward and reverse. 

4. A method as recited in claim 1 wherein said haptic sensations are continuously output 
20 during said playing of said sound data, and wherein an output haptic sensation has a magnitude 

based on an amplitude of said sound data currently being played. 

5. A method as recited in claim 4 wherein said haptic sensations have a magnitude 
directly proportional to said amplitude of said played sound data. 

6. A method as recited in claim 4 wherein said haptic sensations have a magnitude 
25 inversely proportional to said amplitude of said played sound data. 

7. A method as recited in claim 1 wherein said haptic sensations are output only when 
features of said sound data having predetermined characteristics are played. 

8. A method as recited in claim 7 wherein said predetermined characteristics include a 
rise in amplitude of said sound data over a predetermined threshold. 
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9. A method as recited in claim 8 wherein said predetermined characteristics include a 
drop in amplitude of a predetermined amount following said rise in amplitude. 

10. A method as recited in claim 7 wherein said predetermined characteristics include a 
minimum time interval that must occur between two peaks in amplitude to allow a haptic 

5 sensation to be output when the second of said peaks is played. 

11. A method as recited in claim 1 further comprising filtering said sound data such that 
undesired frequencies of sound generated by said sound data are removed and a desired range of 
frequencies remain. 

12. A method as recited in claim 11 wherein said desired range of frequencies are 
1 0 associated with a particular type of haptic sensation. 

13. A method as recited in claim 1 wherein one of said haptic commands is generated 
and a haptic sensation output if a marker that was previously stored for a particular location in 
said sound data is reached during said playing of said sound. 

14. A method as recited in claim 1 further comprising storing a portion of said sound 
15 data in a secondary buffer and processing said portion of said sound data to find said one or more 

characteristics in said sound data real-time during said playing of said, sound data. 

15. A method as recited in claim 1 further comprising displaying a visual representation 
of said sound data and a moving cursor to indicate a current part of said sound data that is being; 
played. 

20 

16. A method for pre-processing sound data to allow haptic sensations associated with 
said sound data to be output when said sound data is played to a user, the method comprising: 

loading at least a portion of said sound data into a memory of a computer, said sound data 
describing a sound waveform; 

25 processing said sound data to find a sound feature having one or more predetermined 

characteristics; and 

when said sound feature is found, storing a marker in a list of markers, wherein said 
marker indicates a location of said associated sound feature in said sound data, said location to be 
associated with at least one. haptic sensation such that when said sound data is played, said 
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associated at least one haptic sensation is output to a user when said marker is reached during 
said playing of said sound data. 

17. A method as recited in claim 16 wherein said one or more predetermined 
5 characteristics include a rise in amplitude of said sound waveform described by said sound data, 

said rise in amplitude being over a predetermined threshold amplitude. 

18. A method as recited in claim 16 wherein said one or more predetermined 
characteristics include a drop in amplitude of a predetermined amount following said rise in 
amplitude. 

10 19. A method as recited in claim 16 wherein said one or more predetermined 

characteristics include a minimum time interval that must occur between two peaks in amplitude 
of said sound waveform to allow a haptic sensation to be output when the second of said peaks is 
played. 

20. A method as recited in claim 16 wherein said processing of said sound data includes 
15 filtering said sound data such that undesired frequencies of said sound data are removed. 

21. A method as recited in claim 16 further comprising storing an indication of one or 
more particular haptic sensations that are to be associated with a particular one of said markers. 

22. A method as recited in claim 21 wherein a type of said one more particular haptic 
sensations is based on said one or more predetermined characteristics of said sound feature to 

20 which said particular marker refers. 

23. A computer readable medium including program instructions for performing steps 
that associate haptic sensations with sound data to assist in navigating through and editing said 
sound data, the steps comprising: 

25 loading at least a portion of said sound data into a memory of a computer; 

playing said sound data such that an audio signal is generated and used for outputting 
audio sound .from an audio device, wherein said playing of said sound is controlled by user input 
received by said computer from a user for navigation of said sound data; and 
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generating haptic commands based on said sound data, said haptic commands used to 
output haptic sensations to said user by a haptic feedback device manipulated by said user and in 
communication with said computer, said haptic sensations corresponding to one or iriore 
characteristics of said sound data to assist said user in discerning features of said sound data 
5 during said navigation through and editing of said sound data. 

24. A method as recited in claim 23 wherein said user can control a speed of said playing 
of said sound data. 

25. A method as recited in claim 23 wherein said user can control a direction of said 
playing of said sound data, said direction including forward and reverse. 

10 26. A method as recited in claim 23 wherein said haptic sensations are continuously 

output during said playing of said sound data, and wherein an output haptic sensation has a 
magnitude based on an amplitude of said sound data currently being played. 

27. A method as recited in claim 23 wherein said haptic sensations are output only when '. 
features of said sound data having predetermined characteristics are played. 

15 28. A method as recited in claim 23 wherein one of said haptic commands is generated 

and a haptic sensation output if a marker that was previously stored for a particular location in 
said sound data is reached during said playing of said sound. 

29. A method as recited in claim 23 further comprising storing a portion of said sound 
data in a secondary buffer and processing said portion of said sound data to find said one or more 
20 characteristics in said sound data real-time during said playing of said sound data. 
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